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rRODUCTION: 


This  report  summarizes  the  principal  results  achieved  so  far  in  this 
contract.  The  primary  tasks  proposed  were  an  examination  of  the  information 
storage  capacity  of  a conventional  multiplexed  hologram  and  also  an  effort 
to  show  that  a hologram  is  capable  of  feature  extraction.  Both  these  tasks 
have  been  successfully  accomplished.  The  latter  effort  led  to  a new  concept 
with  surprisingly  great  potential  in  pattern  recognition  and  artificial 
intelligence.  /fFV* . .T7 ^ ^ / 


CONVENTIONAL  MULTIPLEXED  HOLOGRAMS: 


In  the  first  part  of  the  contract,  a theoretical  and  experimental  in- 
vestigation was  made  of  the  properties  of  a conventional  multiplexed  hologram. 
The  experimental  arrangement  involved  computer  simulation  of  holograms  and 
images  arranged  in  a 64  x 64  pixel  field-of-view.  Connecting  the  image  and 
hologram  pl-anes  were  discrete  Fourier  transforms.  For  this  arrangement  an 
equation  was  derived  which  gave  the  total  amount  of  information  which  could 
be  stored  by  conventional  multiplexing.  Here  conventional  multiplexing  is 
defined  to  be  the  simple  addition  of  subholograms  to  make  the  final  multi- 
plexed hologram.  Thus: 

H (!)  - Rf  (§)  Sx  (§)  + R*  (5)  s2  (5)  + R|  S3  + - - - (1) 

WHERE  a single  index  § represents  the  two  dimensions  of  the 
hologram  in  the  Fourier  plane. 

Given  this  definition  of  multiplexing,  the  storage  capacity  of  the  hologram 
was  predicted  as: 
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WHERE:  D 


total  number  of  data  pixels 


total  data  stored 


number  of  reconstructed  pixels  in  each  subject  scene, 
s(x). 

number  of  subholograms  in  ensemble. 

number  of  pixels  or  ^degrees  of  freedom  In  hologram  and 
image  field. 
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reconstruction  amplitude  signal  to  noise  ratio. 

Note  that  Equation  (2)  predicts  that  the  amount  of  data  which  can  be 
stored  is  independent  of  how  the  pie  is  divided.  We  can  have  few  holograms 
with  many  data  pixels  each  or  many  holograms  each  reconstructing  a few  data 
pixels.  This  flexibility  appears  to  be  a new  result. 

In  order  to  test  Equation  (2)  a parametric  study  was  designed.  The 
reference  patterns  were  selected  from  an  ensemble  of  statistically  uncorre- 
lated random  patterns  (r;(x)) . The  subject  patterns,  (8^(x)),  were  simple 
data  arrays  of  one,  four  and  sixteen  points  which  were  shifted  to  different 
locations  in  the  f ield-of-view  so  as  to  eliminate  ambiguity  in  the  reconstruc- 
tion process.  The  result  of  the  experimentation  was  full  confirmation  of 
Equation  (2). 

ADAPTIVE  HOLOGRAMS: 

The  second  technical  effort  of  the  contract  was  the  successful  attempt 
to  show  that  a hologram  can  be  trained  to  distinguish  between  two  highly 
correlated  images. 

The  nature  of  the  problem  is  as  follows:  During  the  formation  of  a 
hologram,  a reference  image,  r(x)  and  a subject  image  s(x)  are  Fourier  trans- 
formed to  provide  the  patterns  R(§)  and  S(§).  The  reference  is  complex 
conjugated  and  multiplied  by  the  subject  to  form  the  hologram  trace. 

H (§)  - R*  (§)  S (§)  (3) 

Upon  reconstruction,  the  reference  r(x)  is  reinserted,  transformed  and 
then  modulated  by  the  hologram.  lamed lately  downstream  of  the  hologram,  the 
result  is: 

Intermediate  Output  ■ R (§)  R*  (§)  S (5)  (4) 

This  result  is  processed  through  an  inverse  Fourier  transform  and  the 
final  output  image  is: 

I(x)  - (r(x)©r(x))  * s(x)  (5) 


Where  (r(x)  ® r(x))  is  the  autocorrelation  of  s(x).  This  autocorrelation 
defines  a point  spread  function  for  the  reconstruction.  The  closer  the  point 
spread  function  is  to  a delta  function,  the  better  will  be  the  quality  of 
reconstruction. 

Now  suppose  one  reference  r^(x)  is  used  for  the  formation  of  a hologram 
using  S}(x)  as  a subject  while  another,  r2(x),  is  used  for  the  reconstruction. 
The  reconstructed  image  will  then  be: 

I(x)  = (r1(x)  © r2(x))  * s^x)  (6) 

As  long  as  r^  is  partially  correlated  with  r2  there  will  be  a reconstruc- 
tion of  s^(x),  although  the  amplitude  of  reconstruction  will  be  reduced  as 
the  correlation  coefficient  declines.  This  property  is  useful  for  pattern 
recognition  because  with  it,  similar  reference  images,  (r^),  can  produce  the 
same  output. 

However,  suppose  we  wish  to  form  the  hologram  in  such  a way  that  the 
second  reference,  r2>  produces  a completely  different  output,  s2,  with  no 
trace  of  s^  showing.  Can  this  be  done?  The  proposed  answer  was  "yes." 

The  method  -suggested  was  to  form  a multiplexed  hologram  such  that  the  corre- 
lated portions  of  r^  and  r£  cancelled  out,  leaving  the  uncorrelated,  or 
orthogonal  parts,  as  features  which  can  independently  reconstruct  two  separate 
subject  images  s^  and  s2.  This  technique  recognizes  that  residual  crosstalk 
remains  in  the  form  of  a random  background  of  noise  distributed  over  the 
field-of-view.  The  rules  governing  this  crosstalk  are  the  same  as  led  to  the 
derivation  of  Equation  (2). 

During  the  development  of  an  algorithm  to  accomplish  this  cancellation 
task  it  was  realized  that  the  addition  of  a negative  feedback  loop  around  the 
hologram  would  automate  the  process.  The  result  is  a linear  circuit  of  the 
form  illustrated  in  Figure  (1).  In  this  circuit  the  hologram  records  the 
function  A(C)  which  is  delivered  by  the  sunning  junction.  This  recording 
is  weighted  by  a convergence  constant,  c,  and  added  to  the  pre-existing  stock 
of  the  multiplexed  hologram.  Given  reasonable  care  the  process  can  be  made  to 
converge  so  that  the  hologram  takes  on  a limit  value.  In  effect  the  hologram 
acts  as  an  adaptive  servo  controller  and  the  object  being  servo  controlled  is 
the  hologram  itself: 


This  response  of  the  system  can  be  described  by  the  first  order  differential 

equation  (in  the  spatial  Fourier  plane): 

+ c lR<5)l2  H(5,t)  - CR*(§)  S(5)  (7) 

WHERE  R and  S are  coincident  time  dependent  step  function  inputs. 

The  time  response  of  the  system  is  then; 

H(5»t)  * (1  - exp  <-c |r(§) | 2 t))  (8) 

There  are  several  points  of  significance  here.  First,  although  the  holo- 
gram starts  out  having  the  form  H * R*S,  it  ultimately  converges  to  the  form 
H = S/R. 

If  we  write  this  end  result  as; 

H - liSi  _ ( R*£QN  . 

R(S)  V R(S)  R*(S)  / ^ (9) 

We  note  that  the  coefficient  function  of  S(5)  becomes  just  the  ideal 
Wiener  matched  filter  for  the  reference  r(x).  Thus,  adding  a feedback  loop 
and  causing  the  hologram  to  adapt  results  in  the  hologram  adapting  to  become 
an  optimum  filter. 

The  second  point  is  that  the  time  constant  for  the  process: 

T(°  = C|R<\)|  2 (10) 

is  a function  of  the  power  spectral  density.  High  magnitude  spectral  compo- 
nents adapt  (exponentially)  much  faster  than  low  magnitude  values.  A correlary 
of  Equation  (10)  is  that  where  the  amplitude  R(5)  = 0,  the  time  constant 
will  be  infinite  and  no  adaptation  takes  place.  This  leads  to  the  third 
important  point.  Normally,  S(§)/R(?)  will  have  infinities  these  R(5)  is  zero. 

But  this  adaptive  system  takes  infinitely  long  to  adapt  at  this  points  so  the 
infinities  never  develop.  The  system  thus  remains  physically  realizable. 

A number  of  experiments  were  performed  to  demonstrate  the  power  of  the 
device,  one  of  which  is  Illustrated  in  Figure  (2).  Here,  the  image  of  a 
square  is  used  as  the  reference  or  image  to  be  recognized.  It  is  tasked  to 
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reconstruct  the  subject  which  is  an  image  of  a W.  Because  the  autocorrelation 
of  the  reference  is  not  entirely  delta  function  like,  the.  reconstructed  image 
is  initially  broadened.  In  conventional  holography  this  would  be  the  best 
result  that  could  be  obtained.  With  the  adaptive  system,  however,  a few 
iterations  serve  to  suppress  the  errors  produced  by  the  point  spread  function 
and  the  reconstructed  image  cleans  up. 

Having  verified  the  basic  properties  described  by  Equations  (7)  and  (8), 
attention  was  turned  to  the  proposed  requirement  of  having  two  similar  reference 
patterns  reconstruct  two  entirely  different  subject  patterns  with  limited, 
or  no,  crosstalk.  The  results  of  this  experiment  are  illustrated  in  Figure  (3). 

The  references  chosen  were  a normal  square  and  a narrowed  square.  The 
narrow  square  was  paired  with  a subject  which  was  the  image  of  the  letter,  N. 

The  normal  or  wide  square  was  paired  with  the  letter  W.  The  training  process 
was  very  simple.  The  narrow  square  and  N were  presented  to  the  system  and  the 
system  adapted  in  its  usual  fashion.  Then  the  wide  square  and  W were  presented 
and  the  system  adapted  to  the  new  inputs.  This  simple  alternate  presentation 
process  was  repeated  until  the  system  equilibriated  and  the  training  was  then 
completed. 

At  the  beginning  of  the  process  there  was  considerable  crosstalk  with 
the  wide  square  reconstructing  the  N image  as  well  as  the  W and  vice  versa. 

(Note  that  the  W and  N are  located  in  different  places  in  the  FOV  so  that  any 
false  reconstructions  would  be  obvious.)  After  full  equilibrium  is  reached 
all  of  the  false  reconstructions  and  crosstalk  are  eliminated  so  that  the  two 
reference  images,  played  through  the  adaptively  multiplexed  hologram,  recon- 
struct only  the  desired  subjects.  The  technique  appears  to  successfully  per- 
form a feature  extraction  and  virtual  orthogonallzation  of  the  two  similar 
reference  Images.  The  illustration  of  the  experiment  in  Figure  (3)  shows  an 
adaptation  which  has  not  gone  completely  t<;  equilibrium.  Further  experiments 
have  shown  that  almost  all  the  remaining  crosstalk  gets  cleaned  up. 

The  implications  of  this  adaptive  system  are  quite  significant.  One  of 
the  most  important  appears  to  be  that  the  adaptive  hologram  seems  to  be  capable 
of  storing  vastly  more  information  than  can  the  conventional  multiplexed 
hologram.  It  seems  likely  (though  untested)  that  Equation  (2)  no  longer  holds 
for  the  adaptive  hologram. 
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Instead  the  correct  equation  is  probably: 

D = n2  (11) 

With  arbitrarily  large  reconstruction  signal  to  noise  ratio. 

The  reasoning  behind  this  is  that  with  the  crosstalk  eliminated,  the  system 
is  capable  of  storing  as  many  image  vectors  as  there  are  linearly,  independent 
basis  vectors  (that  is  to  say  n images).  Furthermore,  each  image  vector  is 
ccxnposed  of  up  to  n basis  vectors  or  pixels,  for  either  the  reference  or 
the  subject.  Thus,  each  pixel  gets  used  up  to  n times. 

CONCLUSION: 

The  discovery,  during  this  contract  of  the  adaptive  hologram  opens  up 
broad  areas  for  theoretical  and  experimental  investigation.  Applications  range 
from  pattern  recognition  and  artificial  intelligence  to  investigations  of  the 
properties  of  the  nervous  system. 
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<l>  — + c I RC§>  | 2 H(§ , t)  - CR*  (5)  s (§) 

TIME  RESPONSE  EQUATION: 

(2>  H<5.t)  -|£|j  ( 1 - exp  [-C  |r(§)  | 2t]  ) 


b(x) 

OUTPUT 


FIGURE  1.  ADAPTIVE  HOLOGRAPHIC  SYSTEM  WITH  FEEDBACK 
LOOP  INSIDE  FOURIER  TRANSFORMS 
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SUBJECT  INITIAL  RECONSTRUCTION  OF  SUBJECT 
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(PATTERN  TO  BE  RECOGNIZED) 


FIGURE  2.  EXAMPLE  OF  ELIMINATION 

OF  RECONSTRUCTION  ERRORS 
BY  USING  AN  ADAPTIVE 
HOLOGRAM  WITH  NEGATIVE 
FEEDBACK.  THE  FEEDBACK 
LOOP  IS  INSIDE  THE 
TRANSFORMS. 
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